Image Fusion and Stylization Processing Based on Multiscale Transformation and Convolutional Neural Network

With the continuous development of imaging sensors, images contain more and more information, the images presented by different types of sensors are different, and the images obtained by the same type of sensors under different parameters or conditions are also different. Multisource image fusion technology combines images acquired by different types of sensors or the same type of sensors with different parameter settings, which makes the image information more complete, compensates for the limitations of images of the same type, and also allows you to save information about the characteristics of the original image. Multimodal image mosaic and multifocal image mosaic have been studied in detail in two directions. On the one hand, a method based on frequency domain transformation is used for multiscale image decomposition. On the other hand, image extraction with neural network-based methods is proposed. The technology of convolutional neural networks (CNNs) allows to extract richer texture features. However, when using this method for fusion, it is difficult to obtain an accurate decision map, and there are artifacts in the fusion boundary. Based on this, a multifocal fusion method based on a two-stage CNN is proposed. Train the advanced intensive network to classify input image blocks as focus, and then use the appropriate merge rules to get the ideal decision tree. In addition, several versions of the fuzzy learning set have been developed to improve network performance. Experimental results show that the frames of the first stage proposed by the algorithm make it possible to obtain an accurate decision scheme and that the frames of the second stage make it possible to eliminate the pseudo-shadow of the integration boundary.


Introduction
Vision is one of the important ways for humans to perceive the world, understand the world, and explore the world. However, being a reliable carrier of environmental information, the image is subject to such objective realistic factors as the size, color, shape, spatial position of the object-the object, as well as the subjective limitations of the visual system of the human eye, which do not allow obtaining directly and accurately relevant information about the object-the object only through visual observation of the visual system of the human eye, and therefore people tend to use external devices to understand and process some information about the target [1]. In the era of rapid development of information technology, the development of computer vision technology is also very fast. As an important branch of computer vision technology, image fusion technology has made great achievements in just a few decades with the continuous exploration of researchers all over the world. Image fusion is not just an overlay of multiple images, it creates new images with more valuable information [2]. is technology was developed to overcome the limitations of traditional optical lens aperture and other imaging equipment and to take advantage of the complementarity and redundancy of information carried by the multisource images themselves. Special image processing mechanisms combine complementary characteristic components of multisource images, ultimately enabling a more comprehensive and precise representation of all relevant content in the same scene. Image technology is, therefore, a very effective means of image processing and has been successfully applied in infrared detection, remote sensing search, medical imaging, and digital products. In image processor technology, we divide the source image into multiple focused images, medical image groups, telemetry resolutions, and infrared and visible light effects. Multifocus images have long been research centers in the field of image connection [3]. When there are multiple targets in the same scene, the conventional imaging device is limited by their depth of field, single sighting can only make the targets in the focus area into sharp images and blurry images elsewhere, and this special imaging mechanism becomes an obstacle for researchers when observation and analysis of scene information. e emergence of multifocus image fusion technology effectively solves the problem of inconvenient observation caused by image groups with different focal areas; this technology can automatically identify the focus area of each image; the extracted focal area information is fused into an image in which all target objects are clear, detailed information is more abundant, and scene description is more accurate. Multifocus image fusion technology is widely used in military, medical, and imaging equipment development. At the same time, this technology lays a good foundation for subsequent image processing technologies, such as image extraction, target recognition, image classification, and so on, so learning how to improve the algorithm for recognizing the borders of the focus area of images with nonfocus areas and effectively extracting information about the focus area of images are of great importance for the development of multifocus image fusion technology [4]. is paper mainly studies the image fusion processing technology based on convolutional neural network ( Figure 1).

Literature Review
Wang Q. et al. said that with the progress of economy and society, the rapid development of sensor technology, and the increasing number of sensors in application scenarios, the amount of available information is increasing and the forms are more diverse. In order to meet this challenge, information fusion technology came into being [5]. Liang et al. stated that the so-called information fusion refers to the multilevel, multifaceted, and multilevel processing and synthesis of multisource information obtained from multiple sensors in order to obtain richer, more accurate, and more reliable useful information. Image fusion is an important research direction in the field of information fusion, involving sensor technology, artificial intelligence, signal processing, and image processing; it is a comprehensive emerging technology [6]. Singh et al. believed that the so-called image fusion is to use images obtained from different sensors, or images obtained by the same sensor in different imaging methods or at different imaging times, according to certain rules and merge into a new image [7].
e fusion image contains more information than the source image, and the details are richer; the outline is also clearer and can describe the target more accurately, which is convenient for later human observation and computer processing. Zhen et al. proposed that in traditional applications, professional human information observers do this work. Information observers need to observe images of multiple information sources at the same time and use their own visual system and brain to obtain information and make judgments. In this case, the labor load of the observer is large, which is difficult to achieve even after professional training [8]. Azer S. A. et al. stated that multisource image fusion is a new technology to solve this problem. is technology can combine information provided by different types of sensors or different information provided by a single sensor, eliminate redundant information that may exist between information, improve system reliability and serviceability, providing a more accurate, reliable, and comprehensive description of the target or scene for further observation or editing. e combination of CT and MRI images, for example, enables the precise diagnosis of diseases. In Reference [9], Tazeen T. et al. believed that at present, image fusion is not only widely used in military fields such as tracking and recognition, target detection, and situational awareness; it has also been promoted in civil fields such as human visual aids, intelligent transportation, industrial processes, medical imaging and diagnosis, and intelligent manufacturing [10]. Savant et al. stated that in the past 20 years, for image fusion technology at different levels, a lot of in-depth and detailed theoretical and applied research has been carried out. However, so far, the recognized theoretical system and application methods have not yet been formed, and many theoretical and technical problems need to be solved urgently [11]. Bodapati J. D. et al. believed that the research on image fusion technology in China started late and is still backward compared with international research. In terms of basic theory and engineering technology, in-depth research is needed. Image fusion technology refers to combining multiple different images obtained from different sensors or a single sensor multiple times; according to certain rules, it is fused into a new image [12]. Link et al. argued that the adjusted image contains more redundancy and complementary information from the source image, more detailed information, clearer contours, and more accurate target descriptions. Multifocus imaging is one of the research points [13]. Pavan K. et al. stated that according to the principle of convex lens imaging, when the distances between multiple targets and the lens are different, photographic equipment cannot focus these objects on the same focal plane at the same time; that is, they cannot be clearly presented in one image at the same time. erefore, in order to obtain a clear image of each target object, it is necessary to focus and shoot each object separately [14]. rough the multifocus image fusion technology, the reliability of target detection and recognition and the utilization rate of image information can be effectively improved; therefore, the application of this technology in target recognition, machine vision, digital cameras, and other fields is increasingly widespread.

e Concept of Multisource Image Fusion.
Image fusion is a way of combining information from multiple images of the same scene, taken from different sensors, in different places or at different times. Fusion images store all the additional and redundant information of the input image, which plays a significant role in the tasks of visual perception and human image processing. Image fusion is a technology for extracting important texture elements from multisource images and integrating them [15]. e formula for the mathematical representation of the fused image is as follows: Among them, I 1 , I 2 , I 3 , ..., I N is the image to be fused, φ is the fusion rule, and a is a constant and satisfies N n�1 α n � 1. Figure 2 shows a diagram of the image fusion method. For complete integration of information, the results of integration must meet the following requirements: (1) fusion images must retain additional and important information in the input image; (2) no additional information can be generated during the fusion process; these include manually set information and information obtained through image processing techniques; and (3) registration errors and generated noise must be avoided [16].

An Overview of Traditional Multisource Image Fusion
Techniques.
e traditional multisource image fusion method allows manual extraction of the characteristics of multimodal images, but with certain limitations. Among them, traditional methods mainly include regional approach, transform field based method, and sparse representation method [17]. Computational Intelligence and Neuroscience image is divided into regions. A joint area map is created by parsing the map of each source image, producing a final fusion image. (3) A method based on detection of focal areas and significant diagrams separates important foreground objects from the background and thus forms areas that are perceived as coherent [18]. e basic frames based on the regional integration program are shown in Figure 3. e zone-based image fusion algorithm requires reading two or more input images and then using different partitioning algorithms to separate the images into different regions. Use the appropriate element extraction technology to extract various elements from each area, such as edges, textures, outlines, and more. Finally, use the appropriate merge rules to get the latest image. the source image can be broken down into subimages with different dimensions and spatial resolutions. e Ralph Pyramid was developed from the Gold Medal, and the Gaussian Pyramid (GP) uses down sampling technology; the image is decomposed at multiple scales; the postdecomposition images are obtained by the following secondary sampling of the images of the previous layer after low-pass filtering [20]. Assuming that the source image G 0 is the 0th layer of the Gaussian pyramid, the image G l of the l-th layer of the Gaussian pyramid is expressed as follows: en, G l is interpolated and expanded to obtain an enlarged G * l , in order to keep the size of G * l consistent with the size of G l−1 ; the specific formula is as follows: Among them, 0 < l ≤ N, 0 ≤ i < C l , 0 ≤ j < R l , in the formula as follows: where N is the total number of layers of the LP and LP l is the l-th layer image decomposed by the LP. Pyramid is formed by LP 0 , LP 1 , ..., LP N ; any layer image of GP is the changed value of the base layer and its previous layer image after expansion [21]. e specific reconstruction process is as follows:

Merge Images with Multiple Sources Based on Wavelet
Transform. Image feature is extremely important in many imaging applications; it can be arbitrary in size and can dominate at any particular scale. erefore, an analysis with multiple resolutions, e.g., a small wave transmission is a very useful mathematical tool for image analysis and computer visualization. A wavelet is a function generated by dilution and transformation from a single prototype function Ψ. e specific form is as follows [22]: e reason for the wavelet transform is to represent an arbitrary function f as a superposition of a small wave. At the same time, the original function can be reconstructed from the wavelet decomposition. Under constraints, Ψ has "sufficient" decay properties, namely, where Ψ(ω) is the Fourier transform of ψ(t); it can decompose and refactor arbitrary functions. Typically, the wavelet transform uses a discrete form. Considering that we are primarily interested in a signal with a continuous resolution of 2, it can define discrete wavelet transform by a � 2 m and n2 m , where m and n are integers [23]. en, the decomposition formula of the wavelet becomes the following form: Among them, ψ m,n (t) � 2 − m/2 ψ(2 − m t − n), ψ has very special forms, making ψ m,n (t) form a standard orthonormal basis, namely, c m,n � 〈f, ψ m,n 〉 � ψ m,n (t)f(t)dt. (11) In order to do this, we need to construct a scaling function φ, as well as its dilation and transformation form φ m,n (t) � 2 − m/2 φ(2 − m t − n). Let h n � 2 1/2 φ(t − n)φ(2t)dt, g l � (−1) l h 1−l . It can be seen that the following recurrence relation exists between the coefficients c m,n and a m,n : If function f is given in sampled form, these sampling processes are then interpreted as the highest order resolution approximation coefficients a 0,n . A rough approximation of the function can be recursively computed by combining down sampling and filtering operations. Due to their relation to the orthogonal wavelet basis, these filters can provide perfect reconstructions such as follows: FIR filters of finite length have been constructed as wavelet transforms, and the same filters are used for reconstruction and decomposition. However, these filters are not symmetric, so the relationship between them is nonlinear [24]. In order to ensure a perfect refactoring, the following calculations are required: e relationship between the filter and the wavelet function and the scale function is expressed in the following formula:

Image Fusion with Multiple Sources Based on MGA
Method. e Multivariate Geome Analysis (MGA) theory provides better feature extraction functionality in feature representation than traditional pyramidal transformations and small wave transitions. is has led to a breakthrough in multisource image integration. Efficient, multidimensional representations of images are used in image processing such as compression, noise, and image consolidation. Contourlet Transform (CT) is one of the latest technologies with multiple sizes. In addition to the actual 2D image enhancement filter, the flexible directional filter also captures the inherent geometry of the image and provides smooth image shifting in NSCT. e Gibbs phenomenon caused by coefficient correction has been greatly improved over CT as filter interpolation replaces image extraction.

Framework Based on Grayscale Image Fusion.
To simplify and clarify this process, a pair of CT and MR brain images is shown.
e specific integration process is as follows: Step 1. e medical images are resolved to be merged using the NSST algorithm. aA and bB are low-pass subband coefficients. cA s,j and cB s,j are the high-pass subband coefficients at l in layer s.

Computational Intelligence and Neuroscience
Step 2. Low-cut parts are processed using activity level measurements based on energy storage and detail capture.
Step 3. e high-pass part is integrated using the activity level metric based on IQPSO-PCNN.
Step 4. e inverse NSST algorithm is used to generate the final fusion result from the fused low-pass and highpass parts.
Consisting of a geometric and multidimensional imitation system, it offers advantages such as anisotropy, relatively simple structures, efficient data processing, and no directional orientation and is often used as a multidimensional decomposition tool for images [25]. When the dimension n � 2, an imitation system with compound extension can be represented as follows: Among them, ψ ∈ L 2 (R 2 ), L is the space that can be integrated, matrices A and B are inverse matrix of the second class, and |detB| � 1. An arbitrary f ∈ L 2 (R 2 ) is satisfied if ψ AB (ψ) is a Parseval frame. e specific form is as follows: Among them, ψ AB (ψ) is the set of basis functions, A represents the anisotropic matrix of multidimensional intervals, s is the shear matrix used for direction analysis, and j, l, and k are the parameter values for scale, orientation, and translation, respectively. e representation of matrices A and B is as follows: Among them, when a � 4 and s � 1, the synthesized wavelet is a shear wave.
For different decomposition scales, each element ψ 0 j,l,k is supported on a pair of trapezoidal regions, its size is about 2 2j × 2 j , and the slope in the line direction is l2 −j [26].

Objective Evaluation Indicators.
ere is no unified evaluation standard for quality evaluation based on fused images. In most cases, people evaluate image quality based on subjective impressions; this can lead to unconvincing assessment results. As a result, the obtained image is validated from four different angles, and the fusion effect is evaluated globally, including the quality index of local importance (Q o ), Piella structural similarity measure (Q w ), entropy (EN), and standard deviation (SD).

Analysis of Grayscale Image Fusion Results.
is section uses the grayscale image fusion framework to test grayscale image fusion in four different modes, including MR-TI and CT, MR-PD and MR-T1 grayscale images, MR-T1 and MR-T2, as well as MR-T2 and MR-Gad, and provides qualitative analysis and quantitative description of the algorithm. Figure 4 shows the results of the experiments for the MR-T1 and CT datasets. While the LP-SR and ULAP methods give better results than other methods, the extraction of detail and conservation of energy are not as good as described in this chapter. While the mean is not optimal for some images, it is better than others, indicating that the algorithm has the best visual results and objective ratings [27].  Figure 5 shows the laboratory analysis for MR-T1 and MR-PD. e BF and DSIFT methods have a significant resolution limitation such that an adjusted image cannot store distinct information from the source image. LP-SR and ULAP algorithms work well for soft tissues of the brain, but there is still a little less contrast in some areas. It can be clearly observed in the figure that the author's method slightly outperforms other algorithms on EN, Q w , and Q o metrics, indicating that the algorithm is better than others in terms of 6 Computational Intelligence and Neuroscience Computational Intelligence and Neuroscience 7 structural similarity, energy storage, and detail extraction [28].

Conclusion
Multisource image consolidation technology combines images captured by different types of sensors or images of the same type of sensor with different parameters, reducing the redundancy and randomness of the images and improving the image quality and the characteristic information of the image. Multisource image fusion technology is an important branch of computer vision and a research hot spot in the field of image understanding, and it is widely used in the fields of remote sensing, medicine, and science. From this, it can be seen that detailed and in-depth research on multisource image fusion technology is carried out, and it has profound and important significance. Disclosed is a medical image fusion algorithm based on edge conservation and scatter representation enhancement, based on the idea of edge information and scatter representation, which first uses the NSST algorithm to decompose the image at several scales and obtain low frequency and high-frequency subbands. For low frequency subbands which are often affected by detailed information by the scatter representation based fusion method, this paper proposes an improved scatter representation method for low frequency subband fusion. e algorithm effectively improves the ability of the algorithm to conserve energy by eliminating detailed training set features in learning the dictionary through the Sobel operator and guide filter. Since the high-frequency subbands of different medical modalities have different edge information characteristics at the boundary, the author proposes a PCNN fusion strategy based on edge preservation; this strategy can well deal with the problem of blockiness in the fusion boundary. e experimental results show that this method can fuse grayscale images; when the grayscale image and the color image are fused, the objective evaluation index and the subjective visual effect are better than the comparison algorithm.

Data Availability
e statistical data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
e author declares that there are no conflicts of interest.